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A method and system for design optimization that incorpo- 
rates the advantages of both traditional response surface 
methodology (RSM) and neural networks is disclosed. The 
present invention employs a unique strategy called 
parameter-based partitioning of the given design space. In 
the design procedure, a sequence of composite response 
surfaces based on both neural networks and polynomial fits 
is used to traverse the design space to identify an optimal 
solution. The composite response surface has both the power 
of neural networks and the economy of low-order polyno- 
mials (in terms of the number of simulations needed and the 
network training requirements). The present invention 
handles design problems with many more parameters than 
would be possible using neural networks alone and permits 
a designer to rapidly perform a variety of trade-off studies 
before arriving at the final design. 
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METHOD FOR CONSTRUCTING 
COMPOSITE RESPONSE SURFACES BY 
COMBINING NEURAL NETWORKS WITH 
OTHER INTERPOLATION OR ESTIMATION 

TECHNIQUES 5 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application claims the benefit of U.S. Provisional 
Application Nos. 60/096,660, filed Aug. 13, 1998, entitled 10 
“Aerodynamic Design Using Neural Networks,” and 
60/113,310, filed Dec. 22, 1998, entitled “Neural Network- 
Based Redesign of Transonic Turbines for Improved 
Unsteady Aerodynamic Performance,” both of which are 
herein incorporated by reference. 

ORIGIN OF THE INVENTION 

The invention described herein was made by employees 
of the United States Government and may be manufactured 2 o 
and used by or for the Government for governmental pur- 
poses without the payment of any royalties thereon or 
therefor. 

BACKGROUND OF THE INVENTION 25 

1. Technical Field 

The present invention is directed toward an improved 
method and system for design optimization using composite 
response surfaces. These composite response surfaces are 
constructed by combining neural networks with other 30 
interpolation/estimation techniques such as polynomial fits. 

In particular, the present invention relates to a flexible 
process for the efficient use of simulation and experimental 
data in aerodynamic design optimization. 

2. Description of the Related Art 35 

Considerable advances have been made in the past two 

decades in developing advanced techniques for the numeri- 
cal simulation of fluid flows over aerodynamic configura- 
tions. These techniques have now reached a level of maturity 4Q 
where they can be used routinely, in conjunction with 
experiments, in aerodynamic design. However, aerodynamic 
design optimization procedures that make efficient use of 
these advanced techniques are still in their infancy. 

The design of aerodynamic components of aircraft, such 45 
as wings or engines, involves a process of obtaining the most 
optimal component shape that can deliver the desired level 
of -component performance, subject to various constraints, 
c.g., total weight or cost, that the component must satisfy. 
Aerodynamic design can thus be formulated as an optimi- 50 
zation problem that involves the minimization of an objec- 
tive function subject to constraints. A variety of formal 
optimization methods have been developed in the past and 
applied to aerodynamic design. These include inverse design 
methods, adjoint methods, sensitivity derivative-based 55 
methods, and traditional response surface methodology 
(RSM). 

Inverse design methods, as the name suggests, are strictly 
used for inverse design (for example, to design a wing that 
produces a prescribed pressure distribution). The known 60 
inverse design methods do not take into account the viscos- 
ity of the fluid and are therefore used in preliminary design 
only. This method is applicable to a small class of aerody- 
namic design problems, such as those where the entire 
pressure distribution can be specified a priori. 65 

Adjoint methods provide the designer with the gradient of 
the objective function that is being minimized in order to 
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obtain the optimal design. Starting from an initial compo- 
nent shape that is reasonable, the design space is searched 
using this gradient information. The main advantage of this 
method is that the gradient information is obtained very 
rapidly. However, the method has several shortcomings. It is 
difficult to use this method to arrive at an optimal design 
when several engineering disciplines (such as, 
aerodynamics, structures, and heat transfer) need to be 
considered simultaneously. It requires a completely different 
formulation for every discipline and for every set of gov- 
erning equations within each discipline. It is also difficult to 
rapidly evaluate design tradeoffs which require that the 
constraints be changed many times. It is also not possible to 
use existing design or experimental data, or partial or 
unstructured sets of data, to influence the design process. 

Sensitivity derivative-based methods typically require 
that many aerodynamic solutions be obtained in order to 
compute the gradient of the objective function. As the 
number of design parameters increases, these methods can 
become computationally expensive to use. They are also 
sensitive to any noise in the design data sets. Additionally, 
like the adjoint methods, it is not always possible to use 
existing design or experimental data, or partial or unstruc- 
tured sets of data, to influence the design process. Design 
tradeoff studies require that additional aerodynamic simu- 
lations be performed, thus incurring additional expense. 
However, they are applicable to a wide range of aerody- 
namic design problems. 

Response surface methodology (RSM) represents a 
framework for obtaining optimal designs using statistical 
methods such as regression analysis and design of experi- 
ments. Traditional RSM, as it has been used in practice, 
employs low-order regression polynomials to model the 
variation of the aerodynamic quantities, or some measure of 
optimality, with respect to the design variables. This poly- 
nomial model of the objective function in design space is 
then searched to obtain the optimal design. Several such 
polynomial models may have to be constructed to traverse 
the region of design space that lies between the initial design 
and the optimal design. This method does not suffer from the 
shortcomings of the methods mentioned above. However, 
modeling complex functional behaviors using RSM will 
necessitate the use of high-order polynomials with their 
attendant problems. 

Artificial neural networks have been widely used in 
aeronautical engineering. Recent aerodynamic applications 
include, for example, flow control, estimation of aerody- 
namic coefficients, compact functional representations of 
aerodynamic data for rapid interpolation, grid generation, 
and aerodynamic design. Neural networks have been used to 
both model unsteady flows and to optimize aerodynamic 
performance parameters. Significant cost savings have been 
realized in reducing wind tunnel test times by using neural 
nets to interpolate between measurements. Neural network 
applications in aeronautics arc not limited to aerodynamics 
and may be applied in structural analysis and design as well 
as many other technical disciplines. 

In order for neural networks to be used effectively in 
design, it is imperative that the design space be populated 
both adequately and efficiently with simulation or experi- 
mental data. A sparse population results in an inaccurate 
representation of the objective function in design space 
while an inefficient use of aerodynamic data in populating 
the design space could result in excessive simulation costs. 
Current applications of neural networks are restricted to 
simple designs involving only a few design parameters 
because a linear increase in the number of design parameters 



US 6,606,612 B1 


3 

often results in a geometric increase in the number of 
datasets required to adequately represent the design space. 

Therefore, a need exists for adequately and efficiently 
populating large-dimensional design spaces to achieve an 
optimal design. More particularly, to be able to use existing 
design or experimental data, or partial or unstructured sets of 
data, to influence the design process. The subject invention 
herein, solves these problems in a novel manner not previ- 
ously known in the art. 

SUMMARY OF THE INVENTION 

It is therefore the object of the present invention to 
provide an improved method and system for design 
optimization, using composite response surfaces, and having 
the following characteristics: 

ability to start from a generic design that is far from 
optimal; 

easy and economical to use in large dimensional design 
space; 

ability to handle a variety of design objectives; 
ability to easily impose constraints, incorporate design 
guidelines and rules of thumb; 
ability to handle both simulation and experimental data 
simultaneously; 

ability to handle partial data sets and data that lack 
structure; 

insensitivity to noise in the data; 
ability to handle data of varying fidelity as the design 
evolves; 

ability to handle unsteady data (unsteady effects) in the 
design process; 

flexibility to handle additional data as it becomes avail- 
able; 

ability to rapidly perform design trade-off studies; 
ability to leverage the multi-tiered parallelism possible on 
modem 

distributed and parallel computers; and 
ability to execute designs that are influenced by multiple 
disciplines (multi-disciplinary optimization). 

The foregoing object is achieved, as is now described, 
using a method and system that incorporates the advantages 
of both traditional response surface methodology (RSM) and 
neural networks. The present invention employs a unique 
strategy called parameter-based partitioning of the given 
design space. In the design procedure, a sequence of com- 
posite response surfaces based on both neural networks and 
polynomial fits are used to traverse the design space to 
identify an optimal solution. The composite response sur- 
face has both the power of neural networks and the economy 
of low-order polynomials (in terms of the number of simu- 
lations needed and the network training requirements). The 
present invention handles design problems with many more 
parameters than would be possible using neural networks 
alone and permits a designer to rapidly perform a variety of 
trade-off studies before arriving at the final design. 

The above as well as additional objects, features, and 
advantages of the present invention will become apparent in 
the following detailed written description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the invention 
are set forth in the appended claims. The invention itself 
however, as well as a preferred mode of use, further objects 
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and advantages thereof, will best be understood by reference 
to the following detailed description of an illustrative 
embodiment when read in conjunction with the accompa- 
nying drawings, wherein: 

5 FIG. 1 is a graphical representation of a parabolic function 
and the neural network approximations of this function; 

FIG. 2 depicts a geometrical diagram of a three-layer 
neural network for use with the method of the present 
invention; 

FIG. 3 depicts geometrical shapes for two- and three- 
dimensional simplexes also for use with the method of the 
present invention; 

FIG. 4 shows a flowchart of a design process for opti- 
15 mizing a design using both neural networks and polynomial 
fits to construct a composite response surface in accordance 
with one preferred embodiment of the present invention; 

FIG. 5 is a graphical presentation showing the progression 
of design optimization for an airfoil in accordance with one 
20 preferred embodiment of the present invention; 

FIG. 6 shows a graph comparing the instantaneous pres- 
sure contours in the reference and optimized designs of a gas 
generator turbine; and 

FIG. 7 shows a graph comparing the instantaneous pres- 
25 sure contours in the reference and optimized designs of a 
transonic turbine. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 
30 

With references now to the drawings wherein like refer- 
ence numerals refer to like and corresponding parts through- 
out. While there are several methods that can be used to 
represent the functional behavior of design data, neural 
35 networks are particularly suitable for multidimensional 
interpolation where the data is not structured. Since most 
design problems in aerodynamics involve a multitude of 
parameters and datasets that often lack structure, neural nets 
provide a level of flexibility not attainable with other meth- 
40 ods. In fact, partial datasets or even a single data point 
intermingled with more complete datasets can be used to 
influence the design process. 

Aerodynamic design data has traditionally been obtained 
from a variety of sources. In the past, experiments and 
45 simple analyses have provided the majority of data used in 
design. More recently, the methods of Computational Fluid 
Dynamics (CFD) have been used to generate a significant 
portion of the design data. A hierarchy of approximations for 
the governing partial differential equations (i.e., the Navier- 
50 Stokes equations), ranging from the simple potential flow 
equations to the Euler and Reynolds-averaged, Navier- 
Stokes equations, have been used for this purpose. Typically, 
the simpler and lower fidelity potential flow solutions have 
been used in the initial stages of design because they arc 
55 relatively inexpensive to compute; and because a large 
number of solutions arc required at this stage. Here the term 
fidelity is used to denote the extent to which the system of 
equations faithfully represents the physical characteristics of 
the flow. The higher fidelity Euler and Navier- Stokes solu- 
60 tions are generally used in the final stages of design because 
of the high cost of computing these solutions. It has been 
found that neural networks provide a natural framework 
within which a succession of solutions of increasing fidelity 
can be represented and subsequently utilized for optimiza- 
65 tion and design thus reducing overall design costs. The 
design data can come from a variety of sources, including 
experiments and computations. Rules-of-thumb that design- 
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ers have evolved over a number of years can also be 
incorporated within the optimization routines as constraints. 
These facts are of considerable importance to the aircraft 
industry which has accumulated enormous amounts of 
experimental data and numerous design rules over a number 
of decades. 

As mentioned earlier, in order for neural networks to be 
used effectively in design, it is imperative that the design 
space be populated both adequately and efficiently with 
simulation or experimental data. One aspect of the invention 
disclosed here, namely the idea of parameter-based parti- 
tioning of the design space, directly addresses this problem. 
In parameter-based partitioning, the functional dependence 
of the variables of interest with respect to some of the design 
parameters is represented using neural networks, and the 
functional dependence with respect to the remaining param- 
eters is represented using other interpolation/estimation 
techniques, e.g., polynomial regression methods. This 
approach is an extension of traditional response surface 
methods that are based on polynomials alone. The use of 
neural networks in conjunction with other methods results in 
a composite response surface that models the functional 
behavior in design space. When first or second-order poly- 
nomials are used, the number of data sets required increases 
in a linear or quadratic manner, respectively, with the 
number of parameters. 

Parameter-based partitioning greatly reduces the number 
of data sets required to populate the design space and thus 
enables designs involving a larger number of parameters 
than would be possible using neural networks alone. Con- 
sider a simple design that involves three design parameters. 
Typically, 3 3 or 27 simulations would be required to popu- 
late this three-dimensional design space. Clearly, this pro- 
cess results in inordinately large number of simulations in 
high-dimensional design spaces. For example, the number of 
simulations that would be required for a 100-parameter 
design problem is 3 100 , or about 5xl0 47 . On the other hand, 
for a linear representation within a simplex, the current 
approach would require between 100-200 simulations. 

In addition to drastically reducing the computational 
requirements to obtain the simulation data, the method of the 
present invention also has a dramatic impact on the neural 
net training process. First, the reduction in the total amount 
of simulation data greatly reduces the training requirements. 
Second, the use of multiple neural networks to represent the 
data also contributes to reduced training times. This is 
because a pan of the complexity of representing the function 
is transferred from the neural network to the polynomial 
approximation. 

A second aspect of the present invention relates to the 
choice of the initial design point. Clearly, the further the 
optimal design is from this initial design point the larger the 
region of design space that needs to be represented by the 
composite response surface. An inordinately large number 
of data may then be required to adequately populate the 
design space. The method of the present invention uses a 
sequence of composite response surfaces that constitutes a 
search process. Thus, the number of simulations required are 
relatively modest. 

Construction of Composite Response Surface 

Therefore, in accordance with the present invention, com- 
posite response surfaces are constructed using a combination 
of neural networks and other interpolation/estimation tech- 
niques (low order polynomials, Fourier transforms, etc.) By 
way of example and not of limitation, the composite 
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response surfaces will be constructed using neural networks 
and polynomials (as the interpolation/estimation technique). 
It should be appreciated that the primary motivation for 
constructing a composite response surface based on neural 
5 networks and polynomials comes from a careful examina- 
tion of the relative strengths of these two approaches in 
interpolating design data. Neural networks provide a very 
general framework for estimation in multiple dimensions. 
Referring now to FIG. 1 there is shown a graphical repre- 
10 sentation 40 of a parabola 42 given by: 

y=2(x-0.5) 2 

and the neural network approximations to this function. 
Referring once again to FIG. 1, the network is shown trained 
15 with three training pairs (Curve A) and with five training 
pairs (Curve B) 46. The generalization ability obtained when 
only three training pairs 44 are used is inadequate. It should 
be noted that the training error in this case (Curve A) was 
decreased by 25 orders of magnitude. A marked improve- 
20 ment in generalization is seen with the use of five training 
pairs 46. 

The graphs 40 of FIG. 1 demonstrate that neural -network 
based generalization can become unreliable when the 
amount of available training data is very small. However, the 
25 use of a single linear neuron with a preprocessor that 
provides the input nodes with the bias and the values of x 
and x 2 , would yield a perfect fit with just three training pairs. 
It should be noted that such a single linear neuron is, in 
essence, a polynomial fit. The advantage of the polynomial 
30 fit provided by the single linear neuron is that it requires a 
prescribed minimum number of data points for a given 
number of polynomial terms, and, this number increases in 
a polynomial fashion with the number of dimensions. For 
example, if a quadratic fit was used to represent the data, the 
35 number of data points required to compute the coefficients of 
the polynomial would increase quadratically with the num- 
ber of dimensions. If the target function can be locally 
approximated using low-order polynomials then there is an 
advantage to using polynomial fits instead of neural net- 
40 works. 

From the example and discussion above, the present 
invention combines conventional polynomial approxima- 
tions on s-dimensional simplexes with the flexibility that 
neural nets provide. This results in a mathematical model 
45 whose complexity can be adjusted on a dimensional basis to 
suit the function being modeled, thus reducing the amount of 
data required. However, it should be noted that this assumes 
that the local variation of the design objective function with 
some of the geometric parameters can be accurately repre- 
50 sented using low-order polynomials. The terminology 
s-dimcnsional simplex used above refers to a spatial con- 
figuration of s dimensions determined by s+1 equi-spaccd 
vertices, on a hypcr-sphcrc of unit radius, in a space of 
dimension equal to s. By this definition, a two-dimensional 
55 simplex is an equilateral triangle that is circumscribed by a 
unit circle. The method of modeling functional behavior 
using polynomials whose coefficients arc estimated from 
data defined on simplexes is referred to as a Koshal design. 

By way of example, but not of limitation, consider a 
60 design scenario where the data can be generated for pre- 
scribed values of the design parameters. Additionally, 
assume that the variation of the aerodynamic data of interest 
with respect to some of the design parameters is not very 
complex (this may be because the parameter variations are 
65 small or because the underlying function is simple), and, 
hence, does not require the generality of a neural network- 
based estimation scheme. Therefore, simple polynomials 
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can be used to represent the variation of the function with 
these parameters and a neural network can be used for the 
remaining parameters. 

Referring to FIG. 2 there is shown a three-layer neural 
network 50 (with two hidden layers 52 and 60). The varia- 
tion of aerodynamic data along the surface of the airfoil is 
typically far more complicated than the variation with small 
changes in geometric parameter values. Hence, the neural 
network 50 is used to represent aerodynamic data variation 
in physical space. The first node 54 in the input layer is a bias 
node (input of 1.0). The second set of nodes are used to 
specify the physical location 56. In this particular two- 
dimensional design environment, the physical location 56 is 
specified by a single parameter, i.e., the axial location on the 
airfoil surface. Given t geometric parameters that determine 
the shape of the airfoil, assume that the variation of the first 
c parameters results in “complex” variations in the aerody- 
namic data and the variation of the remaining s parameters 
results in fairly “simple” variations in the data that can be 
represented by low-order polynomials (t=s+c). The third set 
of nodes 58 in FIG. 2 accept the first c geometric parameters. 
Pressure values corresponding to axial locations and geom- 
etry parameters specified at the input nodes are obtained at 
the output node 62. 

The variation of the aerodynamic data with the remaining 
s variables is approximated using simple polynomials. For a 
linear variation, the points at which the data are determined 
are located at the vertices of a s-dimensional simplex and are 
at unit distance from the origin. In this case there are s+1 
vertices and s+1 unknown coefficients to be determined. For 
a quadratic variation, in addition to the vertices of the 
simplex, the midpoints of all the edges are included as well. 
This results in (s+l)(s+2)/2 nodes and as many unknown 
polynomial coefficients that must be determined. FIG. 3 
shows the points at which these data are required in two 
dimensions 64 (s=2) and three dimensions 66 (s=3) for a 
quadratic fit. 

In the two-dimensional 64 case shown in FIG. 3 the 
pressure can be approximated as: 

p=a , +a 2 x+a 2 y+a 4 x 2 +a 5 x)H-a 6 y 2 

Given the pressure values p 2 ,p 2 , ... p 6 at the vertices 68 of 
the simplex, the coefficients aj,a 2 , . . . ^ can be obtained 
from the following system of equations: 


i *\ y\ A *iyi y? 

a\ 


P\ 

1 *6 ?6 4 W* yi 

06 


Pt 


The generalization to higher-dimensional simplexes and 
higher-order polynomials is developed as described above 
wherein a certain minimum number of pressure values is 
required depending on the number of dimensions and the 
order of the polynomial used. However, the number of 
pressure values that arc typically used is more than this 
minimum (greater than six in the example above). This helps 
reduce the efTect of noise in the data on the accuracy with 
which the response surface models the functional relation- 
ship between the aerodynamic variable (e.g. pressure) and 
the geometric parameters. The coefficients in this case are 
estimated using a least squares approach. 

The method of combining neural networks and traditional 
polynomial fitting techniques of an embodiment of practic- 
ing the present invention is as follows: 

First, obtain simulation data at each of the vertices of the 
simplex used for the polynomial fit. Multiple Simula- 
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tions will be required at each vertex if some of the 
geometric parameters are represented by the neural net; 
and 

Second, assign one neural net for every vertex of the 
5 simplex. Train each neural net with the simulation data 
generated for the corresponding vertex. The input for 
each net includes the bias value, the axial location 
along the airfoil and the “complex” geometric param- 
eters. 

10 The pressure corresponding to a given axial location and 
a set of geometric parameter values are obtained through the 
following two-step process: 

First, obtain the pressure at each of the vertices of the 
simplex using the corresponding neural nets. This is 
15 easily done since the axial location on the airfoil and 
the values assigned to the “complex” geometric param- 
eters are known; and 

Second, compute the estimates of the polynomial coeffi- 
20 cients and then use the prescribed values of the 
“simple” geometric parameters to obtain the estimate 
for the required pressure value. 

The trained networks together with the polynomial fit 
constitute the composite response surface. The accuracy 
25 with which this composite response surface represents the 
actual functional dependence of the aerodynamic quantities 
on the design parameters is determined by the accuracy of 
the original aerodynamic data, the number of simulations 
used to populate the design space, the network parameters 
30 such as the number of neurons in the hidden layers 52 and 
60 of FIG. 2, and the order of the polynomial used. The 
accuracy with which the networks represent the training data 
is given by the training error, TE, that is minimized to obtain 
the network weights. For any one of the neural networks, 
35 this training error is given by: 

rnnax imax 

te= £ Yj 

n= 1 1=1 

40 

where P" is the set of target pressures, P ” is the output 
pressure from the network, imax is the total number of data 
points on the surface of the airfoil at which the target 
pressures are prescribed, and nmax is the number of simu- 
45 lations used to train this particular network. Note that nmax 
has to be large enough that the functional dependence of the 
pressure on the “complex” variables is modeled accurately 
by the neural networks. The number of neurons is increased 
successively until the training error is sufficiently small. 

50 The accuracy with which the composite response surface 
represents the pressure as a function of the physical and 
geometric parameters can be estimated by comparing the 
pressure distributions of the computed validation datasets 
(which arc different from the training set) to the pressure 
55 distributions obtained using the composite response surface 
for these validation cases. 

This validation process is essential in establishing the 
adequacy of the generalization capabilities of the response 
surface. Typically, this is carried out at the centroid of the 
60 simplex. 

Current Design Method 

Referring now to FIG. 4, there is shown the steps for 
implementing the method of the present invention. The 
65 objective function in step 90 is obtained from the design 
requirements. In step 100 the initial geometry or design 
point is specified. Ideally, this initial geometry should be as 
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close as possible to the optimum. In aerodynamic design, 
there are several approaches, e.g., inverse design 
procedures, meanline analyses, and streamline curvature- 
based methods, that can be used to obtain this initial 
geometry. This geometry serves as the centroid of the first 
simplex. 

Next, as shown in step 120, the design space is populated 
in the vicinity of the initial geometry by constructing a 
simplex in design space around this centroid and the geom- 
etry corresponding to each of the vertices (for a linear 
variation) and interior nodes (for quadratic or higher-degree 
polynomials) is obtained in step 140. The process then 
generates grids for each geometry in step 160. At this stage 
in the process, step 180, the fidelity level is chosen and 
solutions are generated for each geometry. Next, in steps 200 
and 220 the neural networks are trained and the polynomial 
coefficients that define the pressure variation within the 
simplex are computed. The input nodes of the neural nets 
will typically contain parameters that correspond to the 
physical location on the aerodynamic component and those 
geometric parameters that give rise to “complex” behavior 
of the objective function. At this point, step 240, the com- 
posite response surface is defined. 

Referring once again to FIG. 4, the process continues to 
step 260 for a search of the region of the design space 
represented by the composite response surface. Various 
methods can be used to accomplish this constrained search. 
Geometrical and other constraints and rules-of-thumb that 
designers have evolved can be incorporated within this 
search procedure (for example, using a penalty function 
method). In addition, constraints that limit the search pro- 
cedure to the volume of the simplex are also incorporated in 
the search. In step 280, it is determined whether the local 
optimum obtained in the previous step lies on or outside the 
boundaries of the simplex. If the design conditions have not 
been met in step 300 of FIG. 4, i.e., the search procedure 
culminates at a point on or outside the boundaries of the 
simplex, then this point is chosen as a new centroid in step 
320 and the process is repeated until the search culminates 
inside the simplex. However, the process can be stopped at 
any time when the design is deemed adequate as shown in 
step 340. 

Additionally, several types of design refinements may be 
necessary. A particular design may require many iterations 
before the optimal solution is obtained. One reason for this 
could be that the initial design is very different from the 
target. The need to minimize overall design costs dictates 
that one obtain a preliminary design based on low-fidelity, 
low-cost simulations (e.g., potential flow solutions). The 
process of FIG. 4 is then repealed using higher fidelity 
simulations (e.g., Euler or Navier-Slokes solutions). A sec- 
ond level of refinement may involve repeating the process of 
FIG. 4 with a simplex of reduced size. Finally, the geometry 
corresponding to the optimal design is used to verify that it 
performs as required by the design specifications. 

The optimal design obtained above is a point in design 
space that meets all the initial design criteria. However, after 
obtaining this optimal design, the designer often wishes to 
modify the target or the constraints to arrive at a better and 
improved design, or analyze a variety of what-if scenarios. 
Several hundred such trade-off studies may be required 
before the final design is defined. These analyses can be 
performed very efficiently by representing the functional 
dependence of the aerodynamic quantities in the vicinity of 
the design obtained in the process steps of FIG. 4 using the 
composite response surface approximation and once again 
searching this space with the new targets and constraints 
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embedded in the search procedure. Clearly, this process can 
only be used if the new targets are contained in the region 
of design space where the generalization capabilities of the 
response surface are adequate. It has been shown with 
5 aerodynamic design that the search procedure requires two 
to three orders of magnitude less computing time than that 
required for simulation and training the network. This allows 
the designer to rapidly perform a variety of trade-off studies 
that would naturally involve changing the constraints to 
1Q resolve design conflicts or improve the design. 

Application of Design Methodology to Unsteady 
Flow Environments 

Aerodynamic design efforts typically deal with steady 
flows. However, there are many instances where unsteady 
15 effects can have a significant impact on the overall perfor- 
mance of the component. The current design methodology 
provides a natural framework for including unsteady effects 
in the design process. This is possible because of the very 
general manner in which the objective function can be 
2 o defined. 

As an illustration, this invention can be used in a specific 
unsteady aerodynamic design problem, namely, transonic 
high pressure (HP) aircraft engine turbine design. The flow 
in HP turbines is complicated by the presence of shocks, 
25 wakes, tip leakage, and other secondary flow effects. These 
shocks, wakes, and vortical flows are ingested by down- 
stream stages, resulting in complex interactions with one 
another and with the flow in these stages. All of these effects 
are complicated further by the inherent unsteadiness of the 
flow field that results from the relative motion of the rotor 
30 and stator rows and gives rise to unsteady interactions both 
within the HP turbine stages and between the HP turbine and 
the adjacent low pressure (LP) turbine stages. These 
unsteady effects result in poor aerodynamic performance, 
unsteady blade stresses, fatigue, vibration and reduced blade 
35 life. 

The present design method can be used to improve the 
unsteady aerodynamic performance of transonic turbines by 
optimizing the shape of the stator and rotor airfoils. This is 
accomplished by formulating an objective function that 
40 minimizes the unsteady amplitudes on the stator vane (or 
rotor blade) subject to the constraint that the tangential force 
on the rotor airfoil (i.e., turbine work output) does not 
decrease. The pressure amplitude is used as a measure of the 
unsteadiness in the flow field and is defined as the range of 
45 temporal pressure variation on the airfoil surface. 

In the case of turbines where unsteady shocks are present, 
the design process can be used to weaken, or eliminate, the 
shocks. The presence of unsteady shocks results in large 
unsteady pressure amplitudes. Thus the pressure amplitudes 
5Q are directly related to the shock strength. Hence a reduction 
in the unsteady amplitudes on the airfoils can have the 
additional benefit of weakening or eliminating the shocks in 
the flow field. This example also illustrates the use of 
high-fidelity simulations, such as unsteady Navicr-Stokcs 
55 computations, to include all the relevant physics of the 
problem and to steer the optimization within the framework 
of the present invention. 

ILLUSTRATIVE EXAMPLES OF PRACTICING 
THE INVENTION 

60 The following applications have been chosen to demon- 
strate how some of the objectives of the invention have been 
met. 

Metamorphosis of a Generic Shape Into an Optimal 

65 Airf0il 

The present invention was used to reconstruct the shape of 
a turbine airfoil given the desired pressure distribution and 
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some relevant flow and geometry parameters. The shape of 
the airfoil was not known a priori. Instead, it was evolved 
from a simple curved section of nearly uniform thickness. 
The evolved optimal airfoil closely matched the shape of the 
original airfoil that was used to obtain the pressure distri- 
bution. This constitutes a “blind” test. FIG. 5 illustrates the 
evolution of the design. The evolution of the shape of the 
airfoil is shown on the left, while the corresponding pressure 
distributions compared to the target pressure distribution are 
shown on the right. Clearly, the surface pressures approach 
the target pressure as the design progresses. The optimal 
airfoil shown at the bottom has a pressure distribution that 
is very close to the target pressure distribution. 

In this application, the following attributes of the design 
optimization method were demonstrated: 

1. Ability to start from a generic design that is far from 
optimal; 

2. Easy and economical to use in large-dimensional design 
space; 

3. Ability to handle a variety of design objectives; 

4. Ability to handle data of varying fidelity as the design 
evolves; 

5. Flexibility to handle additional data as it becomes avail- 
able; and 

6. Ability to leverage the multi-tiered parallelism possible on 
modem distributed and parallel computers. 

Design in an Unsteady Flow Environment 

The first example deals with the application of this 
method to the redesign of a gas generator turbine with the 
goal of improving its unsteady aerodynamic performance. 
The turbine is a two-stage configuration with an aggressive 
design characterized by high turning angles and high spe- 
cific work per stage. Although the turbine was designed to 
operate in the high-subsonic regime, an unsteady analysis 
showed very strong interaction effects including an unsteady 
moving shock in the axial gap region between the stator and 
rotor rows. It is hypothesized that the strength of this shock 
can be reduced by optimizing the airfoil geometries, and the 
overall unsteady aerodynamic performance of the turbine 
can thereby be improved. Since the shock can only be 
discerned by an unsteady aerodynamic analysis, a time- 
accurate Navier- Stokes solver is coupled to the neural net- 
based optimizer and provides simulation inputs to it. FIG. 6 
compares the instantaneous pressures in the reference and 
optimized designs of a gas generator turbine. Clearly, the 
shocks, labeled A and B on FIG. 6, present in the reference 
design (which appear as clustered contours in the region 
between the stator and rotor rows) have been eliminated in 
the optimized design. The present invention yields a modi- 
fied design that is close to the reference design and achieves 
the same work output, yet has belter unsteady aerodynamic 
performance since the flow through it is shock-free. 

The second example deals with the application of the 
invention to the redesign of a transonic turbine stage. The 
design goal is to improve its unsteady aerodynamic perfor- 
mance by weakening the shocks in the stage and thus 
reducing their effect on turbine aerodynamics. The tangen- 
tial force on the rotor is constrained so that it does not 
decrease during the optimization process. 

The application of this design method yielded a new 
design with a slightly different geometry. FIG. 7 compares 
the instantaneous pressure contours in the reference and 
optimized designs of a transonic HP turbine and shows that 
the unsteady stator trailing edge shock in the reference 
design has been weakened in the optimized design. This 
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leads to lower unsteady pressure amplitudes on the airfoil 
surfaces and improved aerodynamic performance. These 
reductions in unsteady pressure amplitudes were obtained 
without changing the tangential force on the stator and rotor 
5 airfoils or the work output of the turbine. The uncooled stage 
efficiency for the optimized design was nearly identical to 
that for the reference design. 

Therefore, in accordance with the present invention, the 
following attributes of the design optimization method were 
10 demonstrated: 

1. Ability to handle a variety of design objectives; 

2. Ability to easily impose constraints, incorporate design 
guidelines and rules of thumb; 

3. Insensitivity to noise in the data; 

15 4. Ability to include time- varying data (unsteady effects) in 
the design process; 

5. Ability to rapidly perform design tradeoff studies; and 

6. Ability to leverage the multi-tiered parallelism possible on 
modem distributed and parallel computers. 

2 0 It is also important to note that although the present 
invention has been described in the context of providing a 
composite response surface to optimize a design, those 
skilled in the art will appreciate that the mechanisms of the 
present invention are capable of being distributed as a 
25 program product in a variety of forms to any type of 
information handling system, and that the present invention 
applies equally regardless of the particular type of signal 
bearing media utilized to actually carry out the distribution. 
Examples of signal bearing media include, without 
30 limitation, recordable type media such as floppy disk or CD 
ROMs and transmission type media such as analog or digital 
communications links. 

The above description of the method of obtaining the 
composite response surface for a specific design problem is 
35 only an example of how this invention can be applied and 
should not be construed as the only application of the 
invention. The invention is capable of other and different 
embodiments, and its several details are capable of modifi- 
cations in various obvious respects, all without departing 
40 from the invention. 

What is claimed is: 

1. A computer implemented method stored on recordable 
media for constructing at least one composite response 
surface, for use in engineering applications, including but 

45 not limited to optimizing designs and generating regression 
estimates, the method comprising: 

using partitioning of parameters for parallel analysis, each 
such parameter to be analyzed in at least one of a neural 
network and an estimation/intcrpolation process 
50 whereby an objective function that combines the output 
from the neural network and the estimation/ 
interpolation process establishes a condition of 
optimality, and a feedback loop allows for further 
processing in the neural network process and the 
55 estimation/intcrpolation process to construct a compos- 
ite response surface in a design space. 

2. A computer implemented system for constructing at 
least one composite response surface, the system compris- 
ing: 

60 means for using partitioning of parameters for parallel 
analysis, each such parameter to be analyzed in at least 
one of a neural network and an estimation/interpolation 
process whereby an objective function that combines 
the output from the neural network and the estimation/ 
65 interpolation process establishes a condition of 
optimality, and a feedback loop allows for further 
processing in the neural network process and the 
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estimation/interpolation process to construct a compos- 
ite response surface in a design space. 

3. The method of claim 1, wherein said process of 
parameter-based partitioning comprises: 

defining an objective function for a selected physical 5 
response of a selected structure, and providing a group 
G of variables x n (n=l, . . . , N; N^2), upon which the 
physical response is believed to depend; 
assigning each variable x n to a first group G1 of variables 
{y }(j=l, . . . , Nl) having a selected first characteristic 10 
or to a second group G2 of variables {zj(k=l, . . . , N2) 
having a selected second characteristic, where Nl and 
N2 are selected integers satisfying Nl^l, N2^1 and 
N1+N2=N; 

15 

providing a simplex S1(N1) of dimension Nl, centered at 
a selected location, having Nl+1 vertices, and associ- 
ated with the first group G1 of Nl variables; 
for a selected positive integer Ml and a selected sequence 
of node locations, designated by N 1-dimensional coor- 20 
dinates y=y fc (b=l, ...» Ml) within and/or on the 
simplex S1(N1), providing a collection of Ml functions 
{P(y;d)}(d=l, . . . , Ml) that satisfy the conditions 
f(y=y*;d)=0 if b*d, P(y=y*;b)=l, and XP(y;y*)=l for all 
y within or on S1(N1); 25 

for at least one node location, y=y b -, in SI, providing a 
geometric space S2(N2;y z> .) of dimension N2, that is 
orthogonal to a space containing the simplex S1(N1), 
that is associated with the second group of N2 
variables, and that is associated with the node location, 30 

y=y»; 

for at least one space S2(N;y fc ), performing a neural 
network analysis within the space S2(N;y^), using 
known or prescribed data for the structure physical 
response, to obtain a function R(z;y fc .), where z is an 35 
N2-dimensional location coordinate measured in the 
space S2(N2;y fc ); 
providing a sum 

CRS(y.zy=ZP(y;b')R(z;y b )b' 40 

as the composite response surface that approximates 
the dependence of the prescribed data for the structure 
on the group of variables x„; and 
using at least one polynomial fit of the function P(y;y fe ) to 45 
the structure physical response as part of said at least 
one estimation/interpolation analysis. 


4. The method of claim 2, wherein said system for 
constructing said at least one composite surface further 
comprises a computer that is programmed: 

to provide an objective function for a selected physical 
response of a selected structure, and to provide a group 
G of varables x„(n=l, . . . , N; N^2), upon which the 
physical response is believed to depend; 
to assign each variable x„ to a first group G1 of variables 
{y }(j=l, . . . , Nl) having a selected first characteristic 
or to a second group G2 of variables {z*}(k=l , . . . , N2) 
having a selected second characteristic, where Nl and 
N2 are selected integers satisfying Nl^l, N2^1 and 
N1+N2=N; 

to provide a simplex S1(N1) of dimension Nl, centered at 
a selected location, having Nl+1 vertices, and associ- 
ated with the first group G1 of Nl variables; 
for a selected positive integer Ml and a selected sequence 
of node locations, designated by Nl -dimensional coor- 
dinates y=y fc (b=l, . . . , Ml) within and/or on the 
simplex S1(N1), to provide a collection of Ml func- 
tions {P(y;d)}(d=l, . . . , Ml) that satisfy the conditions 
f(y=y„;d)=0 if b*d, P(y=y»;b)=l, and SP(y;y*)=l for all 
y within or on S1(N1); 

for at least one node location, y=y fc ., in SI, to provide a 
geometric space S2(N2;y fr .) of dimension N2, that is 
orthogonal to a space containing the simplex S1(N1), 
that is associated with the second group of N2 
variables, and that is associated with the node location, 

y=y»; 

for at least one space S2(N;y fe ), to perform a neural 
network analysis within the space S2(N;y fo ), using 
known or prescribed data for the structure physical 
response, to obtain a function R(z;y ft ), where z is an 
N2-dimensional location coordinate measured in the 
space S2(N2;y„.); 
to provide a sum 

CRS(y,z)=IJ>(y;b')R(z;y b >)b' 

as the composite response surface that approximates 
the dependence of the prescribed data for the structure 
on the group of variables x n ; and 
an estimation mechanism that is configured to use at least 
one polynomial fit of the function P(y;y*,) to the 
structure physical response as part of said at least one 
estimation/interpolation analysis. 

* * * * * 




